CONTROL SYSTEM AND METHOD FOR CONTROLLING 
AN ACTUATED PROSTHESIS 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[00011 The present application claims the benefit of U.S. provisional patent applications No. 
60/405,281 filed August 22, 2002; No. 60/424,261 filed November 6, 2002; and No. 
60/453,556 filed March 11, 2003, all of which are hereby incorporated by reference. 

TECHNICAL FIELD 

[00021 T he present invention relates to a control system and a method for controlling an 
actuated prosthesis. This invention is particularly well adapted for controlling an actuated leg 
prosthesis for above-knee amputees. 

BACKGROUND OF THE INVENTION 

[00031 As is well known to control engineers, the automation of complex mechanical systems 
is not something easy to achieve. Among such systems, conventional powered artificial limbs, 
or myoelectric prostheses, as they are more commonly referred to, are notorious for having 
control problems. These conventional prostheses are equipped with basic controllers that 
artificially mobilize the joints without any interaction from the amputee and are only capable 
of generating basic motions. Such basic controllers do not take into consideration the dynamic 
conditions of the working environment, regardless of the fact that the prosthesis is required to 
generate appropriate control within a practical application. They are generally lacking in 
predictive control strategies necessary to anticipate the artificial limb's response as well as 
lacking in adaptive regulation enabling the adjustment of the control parameters to the 
dynamics of the prosthesis. Because human limb mobility is a complex process including 
voluntary, reflex and random events at the same time, conventional myoelectric prostheses do 
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not have the capability to interact simultaneously with the human body and the external 
environment in order to have minimal appropriate functioning. 

[00041 For example, in the case of artificial leg prostheses for above-knee amputees, the 
complexity of human locomotion resulted in that the technical improvements of conventional 
leg prostheses have until now been focused on passive mechanisms. This proved to be truly 
detrimental to the integration of motorized leg prostheses onto the human body. According to 
amputees, specific conditions of use of conventional leg prostheses, such as repetitive 
movements and continuous loading, typically entail problems such as increases in metabolic 
energy expenditures, increases of socket pressure, limitations of locomotion speeds, 
discrepancies in the locomotion movements, disruptions of postural balance, disruptions of the 
pelvis-spinal column alignment, and increases in the use of postural clinical rehabilitation 
programs. 

[00051 T he major problem remains that the energy used during mobility mainly stems from 
the user because conventional leg prostheses are not equipped with servomechanisms that 
enable self-propulsion. This energy compensation has considerable short and long-term 
negative effects resulting from the daily use of such prostheses. Accordingly, the dynamic 
role played by the stump during locomotion renders impossible the prolonged wearing of the 
prostheses as it may create, among other things, several skin problems such as folliculitis, 
contact dermatitis, edema, cysts, skin shearing, scarring and ulcers. Although these skin 
problems may be partially alleviated by using a sitiee ftsilicone sheath, a complete suction 
socket, or powder, skin problems remain one of the major preoccupations today. 

[00061 As well, the passive nature of the conventional leg prostheses typically leads to 
movement instability, disrupted movement synchronism and reduced speed of locomotion. 
Recent developments in the field of energy-saving prosthetic components have partially 
contributed to improve energy transfer between the amputee and the prosthesis. Nevertheless, 
the problem of energy expenditure is still not fully resolved and remains the major concern. 
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lOOOTLConsidering this background, it clearly appears that there was a need to develop an 
improved control system and a new method for controlling an actuated prosthesis in order to 
fulfill the needs of amputees, in particular those of above-knee amputees. 

SUMMARY OF THE INVENTION 

[00081 In accordance with one aspect of the present invention, there is provided a method for 
determining a portion of locomotion and a phase of locomotion portion in view of controlling 
an actuated prosthesis in real time, the method comprising: 

[00091 p roviding a plurality of main artificial proprioceptors; 

[00101 receiving a data signal from each of the main artificial proprioceptors; 

1001iL°btaining a first and a second derivative signal for each data signal; 

[OOHLobtaining a third derivative signal for at least one of the data signals; 

[00131 u sing a set of a first state machines to select one state among a plurality of possible 
states for each main artificial proprioceptor with the corresponding data and derivative signals; 

[00141 g enerating the phase of locomotion portion using the states of the main artificial 
proprioceptors; and 

[00151 using a second state machine to select the portion of locomotion among a plurality of 
possible portions of locomotion using events associated to the data signals. 

[00161 In accordance with another aspect of the present invention, there is provided a method 
for controlling an actuated prosthesis in real time, the method comprising: 

[00171 p roviding a plurality of main artificial proprioceptors; 

[00181 receiving a data signal from each of the main artificial proprioceptors; 
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[00191 obtaining a first and a second derivative signal for each data signal; 

[00201 obtaining a third derivative signal for at least one of the data signals; 

[00211 u sing a set of first state machines to select one state among a plurality of possible states 
for each main artificial proprioceptor with the corresponding data and derivative signals; 

[00221 g enerating the phase of locomotion portion using the states of the main artificial 
proprioceptors; 

[00231 using a second state machine to select the portion of locomotion among a plurality of 
possible portions of locomotion using events associated to the data signals; 

[00241 calculating a locomotion speed value; 

I00251_determining coefficient values from a lookup table using at least the phase of 
locomotion portion, the portion of locomotion and the locomotion speed value; 

i0026]_calculating at least one dynamic parameter value of the actuated prosthesis using the 
coefficient values from the lookup table; and 

1002TLconverting the dynamic parameter value into an output signal to control the actuated 
prosthesis. 

[00281 In accordance with a further aspect of the present invention, there is provided a device 
for determining a portion of locomotion and a phase of locomotion portion in view of 
controlling an actuated prosthesis in real time using a plurality of main artificial 
proprioceptors, the device comprising: 

[00291 a data signal input for each of the main artificial proprioceptors; 

[00301 m eans for obtaining a first and a second derivative signal for each data signal; 
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[00311 means for obtaining a third derivative signal for at least one of the data signals; 

[00321 a set of first state machines, the first state machines being used to select one state 
among a plurality of possible states for each main artificial proprioceptor with the 
corresponding data and derivative signals; 

[00331 m eans for generating the phase of locomotion portion using the states of the main 
artificial proprioceptors; and 

[00341 a second state machine, the second state means being used to select the portion of 
locomotion among a plurality of possible portions of locomotion using events associated to the 
data signals. 

100351 In accordance with a further aspect of the present invention, there is provided a control 
system for controlling an actuated prosthesis in real time, the system comprising: 

[00361 a plurality of main artificial proprioceptors; 

[00371 means for obtaining a first and a second derivative signal for each data signal; 

[00381 m eans for obtaining a third derivative signal for at least one of the data signals; 

[00391 a set of first state machines, the first state machines being used to select one state 
among a plurality of possible states for each main artificial proprioceptor with the 
corresponding data and derivative signals; 

[00401 m eans for generating the phase of locomotion portion using the states of the main 
artificial proprioceptors; 

[00411 a second state machine, the second state machine being used to select the portion of 
locomotion among a plurality of possible portions of locomotion using events associated to 
data signals; 
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[00421 means for calculating a locomotion speed value; 

[00431 m eans for storing a lookup table comprising coefficient values with reference to at 
least phases of locomotion, portions of locomotion and locomotion speed values; 

[00441 means for determining actual coefficient values from the lookup table using at least the 
phase of locomotion portion, the portion of locomotion and the locomotion speed value; 

[00451 m eans for calculating at least one dynamic parameter value of the actuated prosthesis 
using the coefficient values from the lookup table; and 

[00461 m eans for converting the dynamic parameter value into an output signal to control the 
actuated prosthesis. 

[00471 These and other aspects of the present invention are described in or apparent from the 
following detailed description, which description is made in conjunction with the 
accompanying figures. 

BRIEF DESCRIPTION OF THE FIGURES 

[00481 FIG. 1 is a block diagram showing the control system in accordance with a preferred 
embodiment of the present invention^ 

[00491 FIG. 2 is a perspective view of an example of an actuated prosthesis with a front 
actuator configurationr; 

[00501 F IG. 3 is a perspective view of an example of an actuated prosthesis with a rear 
actuator configuration; 

[00511 F IG. 4 is an upper schematic view of an insole provided with plantar pressure sensors^ 
[00521 FIG. 5 is a cross sectional view of a sensor shown in FIG. 4r; 
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[00531 FIG. 6 is an example of a state machine diagram for the selection of the portion of 
locomotion; 

100541 FIG. 7 is an example of the phases of locomotion portion within one portion of 
locomotion (BTW) in the state machine diagram shown in FIG. 6t; 

[00551 FIGS. 8a to 8d are examples of four data signals using plantar pressure sensors during 
typical walking on flat groundr; 

[00561 FIGS. 9a to 9d give an example of a data signal obtained from a plantar pressure sensor 
at the calcaneus region and its first three differentialsT; 

[00571 FIGS. 10a to lOd give an example of a data signal obtained from a plantar pressure 
sensor at the metatarsophalangeal (MP) region and its first three differentials^ 

[00581 FIGS. 11a to lid give an example of the states of a plantar pressure sensor with 
reference to the data signal and its three first d i ff o r o ntiation differentiations for a plantar 
pressure sensor at the calcaneous region^ 

[00591 FIGS. 12a to 12c give an example of the states of a plantar pressure sensor with 
reference to the data signal and its three first differentiation for a plantar pressure sensor at the 
metatarsophalangeal (MP)regionT; 

[00601 FIG. 13 is an example of a state machine diagram for the selection of the state of the 
plantar pressure sensors for the calcaneous region^; 

[00611 FIG. 14 is an example of a state machine diagram for the selection of the state of the 
plantar pressure sensors at the metatarsophalangeal (MP) region; 

[00621 FIG. 15 is an overall block diagram of the Phase Recognition Module (PRM)r); 

[00631 FIG. 16 is a block diagram showing the zero calibration^ 



8 



[00641 FIG. 17 is a block diagram showing the subject's weight calibration; 
[00651 FIG. 18 is a block diagram of the Trajectory Generator (TG^ 

[00661 FIG. 19 is a block diagram showing the creation of the Trajectory Generator (TG) 
lookup tables 

[00671 FIG. 20 is a graph showing an example of curve representing a kinematic or kinetic 
variable for a given portion of locomotion, phase of locomotion portion and subject's speedy 
and 

[00681 FIG. 21 is an enlarged representation of FIG. 20. 

ACRONYMS 

[00691 The detailed description and figures refer to the following technical acronyms: 
[00701 A/D Analog/Digital 

[00711 BDW "Downward Inclined Walking - Beginning path" portion of locomotion 

[00721 BGD "Going Down Stairs - Beginning path" portion of locomotion 

[00731 BGU "Going Up Stairs - Beginning path portion of locomotion 

[00741 BTW "Linear Walking - Beginning path" portion of locomotion 

I0075]_BTW_SWING^Detection of typical walking gr_l e g gr i eg during leg swing 

[00761 BUW "Upward Inclined Walking - Beginning path" portion of locomotion 

[00771 CDW "Downward Inclined Walking - Cyclical path" portion of locomotion 

[00781 CGD "Going Down Stairs - Cyclical path" portion of locomotion 

[00791 CGU "Going Up Stairs - Cyclical path" portion of locomotion 

[00801 CTW "Linear Walking - Cyclical path" portion of locomotion 
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[00811 CUW "Upward Inclined Walking - Cyclical path" portion of locomotion 

100821 ECW "Curve Walking Path" portion of locomotion 

[00831 EDW "Downward Inclined Walking - Ending path" portion of locomotion 

100841 EGD "Going Down Stairs - Ending path" portion of locomotion 

[00851 EGU "Going Up Stairs - Ending path" portion of locomotion 

100861 ETW "Linear Walking - Ending path" portion of locomotion 

100871 EUW "Upward Inclined Walking - Ending path" portion of locomotion 

100881 FR_BIN X Detection of a positive f re 

100891 FRfst_BIN x Detection of positive first differentiation of f ra 

100901 FRsec_BIN x Detection of positive second differentiation of f ra 

100911 FRtrd_BIN x Detection of positive third differentiation of f re 

100921 FR_HIGH X Detection of f re level above the STA envelope 

100931 FR_LOW x Detection of f„ level between the zero envelope and the STA 

envelope 

100941 FSR Force Sensing Resistor 

100951 GR POSy Detection of a positive g^ 

100961 MIN SIT Detection of a minimum time in portion SIT 

100971 MP Metatarsophalangeal 

100981 PID Proportional-Integral-Differential 

100991 PKA SDWSit down knee angle 

1001001 P KA ETWEnd walking knee angle 
1001011 P KA STA Stance knee angle 



[001021 PKA SIT Sit down knee angle 

1001031 PKA SUP RAMPStanding up knee angle 

1001041 P PMV Plantar Pressure Maximal Variation 

1001051 PPS Plantar Pressure Sensor 

1001061 PRM Phase Recognition Module 

1001071 R EG Regulator 

1001081 RF Radio Frequency 

f001091 SDW "Sitting down" portion of locomotion 

1001101 SIT "Sitting" portion of locomotion 

1001111 STA "Stance of feet" portion of locomotion 

1001121 STA BIN Detection of a static evolution of all f„ 

1001131 STATIC GRy Detection of gry level below the zero angular speed 

envelope and the zero acceleration envelope 



[001141 


sum a 


Localized plantar pressure signal of left foot 


[001151 


sumb 


Localized plantar pressure signal of right foot 


[001161 


sunic 


Localized plantar pressure signal of both calcaneus 


[001171 


SUHld 


Localized plantar pressure signal of both MP 


[001181 


sum e 


Localized plantar pressure signal of both feet 


[001191 


SUM BIN y 


Non-Zero of sum y 


[001201 


SUP 


"Standing Up" portion of locomotion 


[001211 


SVD 


Singular Values Decomposition 


[001221 


SWINGy 


Detection of a swing prior to a foot strike 
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[001231 T G Trajectory Generator 

[001241 XHLSB Heel Loading State Bottom (X = Left (L) or Right (R)) 

[001251 X HLSM Heel Loading State Middle (X = Left (L) or Right (R)) 

[001261 XHLST Heel Loading State Top (X = Left (L) or Right (R)) 

[001271 XHSTA Heel STAtic state (X = Left (L) or Right (R)) 

[001281 XHUSB Heel Unloading State Bottom (X = Left (L) or Right (R)) 

[001291 XHUST Heel Unloading State Top (X = Left (L) or Right (R)) 

[001301 XHZVS Heel Zero Value State (X = Left (L) or Right (R)) 

[001311 X MLSM MP Loading State Middle (X = Left (L) or Right (R)) 

[001321 X MLST MP Loading State Top (X = Left (L) or Right (R)) 

[001331 XMSTA MP STAtic state (X = Left (L) or Right (R)) 

[001341 X MUSB MP Unloading State Bottom (X = Left (L) or Right (R)) 

1001351 XMUST MP Unloading State Top (X = Left (L) or Right (R)) 

[001361 XMZVS MP Zero Value State (X = Left (L) or Right (R)) 

[001371 ZV FRfsL Threshold to consider the first differentiation of f„ to be 
positive. 

[001381 ZV_FRsec x Threshold to consider the second differentiation of f„ to be 

positive. 

[001391 ZV FRtrd, Threshold to consider the third differentiation of f„ to be 
positive. 

[001401 ZV FRv Threshold to consider f ra to be positive 

[001411 ZV SUMfst Threshold to consider the absolute value of the 1 st diff. of sum y 
to be positive. 
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[001421 ZV SUMsec Threshold to consider the absolute value of the 2 nd diff. of sum y 
to be positive 

DETAILED DESCRIPTION OF THE INVENTION 

[001431 The appended figures show a control system (10) in accordance with the 

preferred embodiment of the present invention. It should be understood that the present 
invention is not limited to the illustrated implementation since various changes and 
modifications may be effected herein without departing from the scope of the appended 
claims. 

[001441 FIG. 1 shows the control system (10) being combined with an autonomous 

actuated prosthesis for amputees. It is particularly well adapted for use with an actuated leg 
prosthesis for above-knee amputees, such as the prostheses (12) shown in FIGS. 2 and 3. 
Unlike conventional prostheses, these autonomous actuated prostheses (12) are designed to 
supply the mechanical energy necessary to move them by themselves. The purpose of the 
control system (10) is to provide the required signals allowing to control an actuator (14). To 
do so, the control system (10) is interfaced with the amputee using artificial proprioceptors 
(16) to ensure proper coordination between the amputee and the movements of the actuated 
prosthesis (12). The set of artificial proprioceptors (16) captures information, in real time, 
about the dynamics of the amputee's movement and previd eprovides that information to the 
control system (10). The control system (10) is then used to determine the joint trajectories 
and the required force or torque that must be applied by the actuator (14) in order to provide 
coordinated movements. 

[001451 FIG. 2 shows an example of an actuated leg prosthesis (12) for an above-knee 

amputee. This prosthesis (12) is powered by a linear actuator (14). The actuator (14) moves a 
knee member (20) with reference to a trans-tibial member (22), both of which are pivotally 
connected using a first pivot axis. More sophisticated models may be equipped with a more 
complex pivot or more than one pivot at that level. 
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[001461 An artificial foot (24) is provided under a bottom end of the trans-tibial member 

(22). The knee member (20) comprises a connector (25) to which a socket (26) can be 
attached. The socket (26) is used to hold the sump of the amputee. The design of the knee 
member (20) is such that the actuator (14) has an upper end connected to another pivot on the 
knee member (20). The bottom end of the actuator (14) is then connected to a third pivot at 
the bottom end of the trans-tibial member (22). In use, the actuator (14) is operated by 
activating an electrical motor therein. This rotates, in one direction or another, a screw (28). 
The screw (28) is then moved in or out with reference to a follower (30), thereby changing the 
relative angular position between the two movable parts, namely the knee member (20) and 
the trans-tibial member (22). 

[001471 FIG. 3 shows an actuated leg prosthesis (12) in accordance to a rear actuator 

configuration. This embodiment is essentially similar to that of FIG. 2 and is illustrated with a 
different model of actuator (14). 

[001481 It should be noted that the present invention is not limited to the mechanical 

configurations illustrated in FIGS. 2 and 3. The control system (10) may be used with a leg 
prosthesis having more than one joint. For instance, it can be used with a prosthesis having an 
ankle joint, a metatarsophalangeal joint or a hip joint in addition to a knee joint. Moreover, 
instead of a conventional socket^ a osseo-integrated devices could also be used, ensuring a 
direct attachment between the mechanical component of the prosthesis and the amputee 
skeleton. Other kinds of prostheses may be used as well. 

[001491 Referring back to FIG. 1, the information provided by the artificial 

proprioceptors (16) are used by the control system (10) to generate an output signal. These 
output signals are preferably sent to the actuator (14) via a power drive (32) which is itself 
connected to a power supply (34), for instance a battery, in order to create the movement. The 
power drive (32) is used to control the amount of power being provided to the actuator (14). 
Since the actuator (14) usually includes an electrical motor, the power drive (32) generally 
supplies electrical power to the actuator (14) to create the movement. 
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[001501 Preferably, feedback signals are received from sensors (36) provided on the 

prosthesis (12). In the case of an actuated leg prosthesis (12) such as the one illustrated in 
FIGS. 2 and 3, these feedback signals may indicate the relative position measured between 
two movable parts and the torque between them. This option allows the control system (10) to 
adequately adjust the output signal. Other types of physical parameters may be monitored as 
well. 

[001511 The control system (10) shown in FIG. 1 comprises an interface (40) through 

which data signals coming from the artificial proprioceptors (16) are received. They may be 
received either from an appropriate wiring or from a wireless transmission. In the case of 
actuated leg prostheses for above-knee amputees, data signals from the artificial 
proprioceptors (16) provided on a healthy leg are advantageously sent through the wireless 
transmission using an appropriate RF module. For example, a simple off-the-shelf RF module 
with a dedicated specific frequency, such as 916 MHz, may be used. For a more robust 
implementation though, the use of a RF module with a spread spectrum or frequency hopper is 
preferable. Of course, other configurations may be used as well, such as a separate A/D 
converter, different resolution or sampling values and various combinations of communication 
link technologies such as wired, wireless, optical, etc. 

[001521 The control system (10) further comprises a part called "Phase Recognition 

Module" or PRM (42). The PRM (42) is a very important part of the control system (10) since 
it is used to determine two important parameters, namely the portion of locomotion and the 
phase of locomotion portion. These parameters are explained later in the text. The PRM (42) 
is connected to a Trajectory Generator, or TG (44), from which dynamic parameters required 
to control the actuated prosthesis (12) are calculated to create the output signal. A lookup 
table (46) is stored in a memory connected to the TG (44). Moreover, the control system (10) 
comprises a regulator (48) at which the feedback signals are received and the output signal can 
be adjusted. 
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[001531 Software residing on an electronic circuit board contains all the above 

mentioned algorithms enabling the control system (10) to provide the required signals 
allowing to control the actuator (14). More specifically, the software contains the following 
three modules: the Phase Recognition Module (PRM), the Trajectories Generator (TG) and the 
Regulator (REG). Of course, any number of auxiliary modules may be added. 

[001541 The artificial proprioceptors (16) preferably comprise main artificial 

proprioceptors and auxiliary artificial proprioceptors. The main artificial proprioceptors are 
preferably localized plantar pressure sensors which measure the vertical plantar pressure of a 
specific underfoot area, while the auxiliary artificial proprioceptors are preferably a pair of 
gyroscopes which measure the angular speed of body segments of the lower extremities and a 
kinematic sensor which measures the angle of the prosthesis knee joint. The plantar pressure 
sensors are used under both feet, including the artificial foot. It could also be used under two 
artificial feet if required. One of the gyroscope gyroscopes is located at the shank of the 
normal leg while the other is located on the upper portion of the prosthesis above the knee 
joint. As for the kinematic sensor, it is located at the prosthesis knee joint. Other examples of 
artificial proprioceptors (16) are neuro-sensors which measure the action potential of motor 
nerves, myoelectrical electrodes which measure the internal or the external myoelectrical 
activity of muscles, needle matrix implants which measure the cerebral activity of specific 
region of the cerebrum cortex such as motor cortex or any other region indirectly related to the 
somatic mobility of limbs or any internal or external kinematic and/or kinetic sensors which 
measure the position and the torque at any joints of the actuated prosthesis. Of course, 
depending on the application, additional types of sensors which provide information about 
various dynamics of human movement may be used. 

[001551 FIG. 4 shows a right insole (§010) provided with two plantar pressure sensors 

(16) positioned at strategic locations. Their size and position were defined in accordance with 
the stability and the richness (intensity) of the localized plantar pressure signals provided by 
certain underfoot areas during locomotion. Experimentation provided numerous data 
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concerning the spatial distribution of foot pressures and more specifically on the Plantar 

Pressure Maximal Variation (PPMV) during locomotion. The PPMV, denoted A max / r/ y 9 

was defined as the maximum variation of the plantar pressure at a particular point (underfoot 
area of coordinate i j) during locomotion. The X-Y axis (52) in FIG. 4 was used to determine 
the i j coordinates of each underfoot area. 



[001561 A PPMV of a given underfoot area of coordinates i j during a given step 

denoted event x, is defined as stable, through a set of N walking steps, if the ratio of the 
absolute difference between this PPMV and the average PPMV over the set is inferior to a 
certain value representing the criteria of stability, thus: 



Amax^r,ij| x 


N 

max r,y| n 

n=0 
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Equation 1 
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A max f rij | is the PPMV localized at underfoot area 
of coordinates i, j during the event x, thus 

• A max /J =f r T(k)\ -frt(k)\ fortheeventx 

• K is the number of samples (frames), 

• N is the number of steps in the set, 
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S is the chosen criteria to define if a given PPMV is 
stable. 



[001571 A PPMV of a given underfoot area of coordinates i,j during a given step 

denoted event x 3 is defined as rich in information, through a set of N walking steps, if the ratio 
between the PPMV and the average PPMV of the set is superior to certain value representing 
the criteria of richness, thus: 



^max^r.ij | 



> (r%> 
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/ i max r,y | 
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N 



Equation 2 



where A | ^ is t h e PPMV localized at underfoot area 
of coordinates i,j during the event x, thus 

• Amaxfriil = f ™ x (k)| - f™ (k)| for the event x 

max r,ij| x r,y v '|k-»0toK r '« V / lk-^0toIC 

• K is the number of samples (frames), 

• N is the number of steps in the set, 

R is the chosen criteria to define if a given PPMV 

• is rich in information. 

[001581 It was found by experimentation that the size and the position of plantar 

pressure sensor are well defined when the criteria are set at 5 % and §010 % for the stability 
and the richness PPMV respectively. As a result, it was found that the calcaneus and the 
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Metatarsophalangeal (MP) regions are two regions of the foot sole where the PPMV may be 
considered as providing a signal that is both stable and rich in information. 

[001591 In FIG. 4, the plantar pressure sensors (16) are provided in a custom-made 

insole (§O10) 5 preferably in the form of a standard orthopedic insole, that is modified to embed 
the two sensors (16) for the measurement of two localized plantar pressures. Each sensor (16), 
as shown in FIG. 5, is preferably composed of a thin Force-Sensing Resistor (FSR) polymer 
cell (54) directly connected to the interface (40) or indirectly using an intermediary system 
(not shown), for instance a wireless emitter. Mechanical adapters may be used if FSR cells of 
appropriate size are not available. The FSR cell (54) has a decreasing electrical resistance in 
response to an increasing force applied perpendicularly to the surface thereof. Each cell (54) 
outputs a time variable electrical signal for which the intensity is proportional to the total 
vertical plantar pressure over its surface area. 

[001601 The normalized position of the pressure sensors and their size are shown in 

Table 1, where the length L and the width W are respectively the length and the width of the 
subject's foot. The coefficients in Table 1 have been obtained by experimentation. A typical 
diameter for the plantar pressure sensors (16) is between 20 and 30 mm. 
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Table 1 - Normalized position and size of pressure sensors 



Area 


Position (X, Y) Size (diameter) 


Calcaneus 


(0.51W,0.14L) 0.29 Vl-W 


MP 


(0.47 W.0.76 L) 0.24 Vl -W 



[001611 In use, the PRM (42) ensures, in real-time, the recognition of the phase of 

locomotion portion and the portion of locomotion of an individual based on the information 
provided by the artificial proprioceptors (16). The PRM (42) is said to operate in real time, 
which means that the computations and other steps are performed continuously and with 
almost no delay. 

[001621 In accordance with the present invention, it was found that data signals received 

from individual artificial proprioceptors (16) can provide enough information in order to 
control the actuator (14) of an actuated prosthesis (12). For instance, in the case of plantar 
pressure sensors, it has been noticed experimentally that the slope (first derivative), the sign of 
the concavity (second derivative) and the slope of concavity (third derivative) of the data 
signals received from plantar pressure sensors, and of combinations of those signals, give 
highly accurate and stable information on the human locomotion. The PRM (42) is then used 
to decompose of the human locomotion into three levels, namely the states of each artificial 
proprioceptor (16), the phase of locomotion portion and the portion of locomotion. This 
breakdown ensures the proper identification of the complete mobility dynamics of the lower 
extremities in order to model the human locomotion. 

[001631 The actual states of each main artificial proprioceptor depict the first level of 

the locomotion breakdown. This level is defined as the evolution of the main artificial 
proprioceptors 5 sensors during the mobility of the lower extremities. Each sensor has its 
respective state identified from the combination of its data signal and its first three differential 
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signals. For the main artificial proprioceptors of the preferred embodiment, which provide 
information about localized plantar pressures, it has been discovered experimentally that the 
localized plantar pressures signals located at the calcaneous and at the metatarsophalangeal 
(MP) regions may be grouped into seven and six states respectively. 

1001641 For the sensors at the calcaneous regions, the states are preferably as follows: 



[001651 



_XHLSB Heel Loading State Bottom (X = Left (L) or Right (R)) 



1001661 X HLSM Heel Loading State Middle (X = Left (L) or Right (R)) 

[001671 X HLST Heel Loading State Top (X = Left (L) or Right (R)) 

1001681 X HSTA Heel STAtic State (X = Left (L) or Right (R)) 

[001691 X HUSB Heel Unloading State Bottom (X = Left (L) or Right (R)) 

[001701 XHUST Heel Unloading State Top (X - Left (L) or Right (R)) 

[001711 X HZVS Heel Zero Value State (X = Left (L) or Right (R)) 



[001721 For the sensors at the MP regions, the states are preferably as follows: 

[001731 X MLSB MP Loading State Bottom (X = Left (L) or Right (R)) 

[001741 XMLST MP Loading State Top (X = Left (L) or Right (R)) 

[001751 X MSTA MP STAtic State (X = Left (L) or Right (R)) 

1001761 X MUSB MP Unloading State Bottom (X = Left (L) or Right (R)) 

[001771 X MUST MP Unloading State Top (X = Left (L) or Right (R)) 

[001781 X MZVS MP Zero Value State (X = Left (L) or Right (R)) 

1001791 Identifying the states at each sensor allows to obtain the second level of the 

locomotion breakdown, referred to as the phase of locomotion portion. The phase of 
locomotion portion is defined as the progression of the subject's mobility within the third level 
of locomotion breakdown, namely the portion of locomotion. This third level of the 
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locomotion breakdown defines the type of mobility the subject is currently in, such as, for 
example, standing, sitting or climbing up stairs. Each locomotion portion contains a set of 
sequential phases illustrating the progression of the subject's mobility within that locomotion 
portion. The phase sequence mapping for each locomotion portion has been identified by 
experimentation according to the evolution of the state of the localized plantar pressures 
throughout the portion. 



[001801 


The portions of locomotion are preferably as follows: 


[001811 


BDW 


"Downward Inclined Walking - Beginning path" 


[001821 


BGD 


"Going Down Stairs - Beginning path" 


[001831 


BGU 


"Going Up Stairs - Beginning path 


[001841 

1 vul V? W | 


BTW 


"Linear Walking - Beginning path" 


[001851 


BUW 


"Upward Inclined Walking - Beginning path" 


[001861 

| V V -M* \J V 1 


CDW 


"Downward Inclined Walking - Cyclical path" 


[001871 


CGD 


"Going Down Stairs - Cyclical path" 


1001881 


CGU 


"Going Up Stairs - Cyclical path" 


[001891 


CTW 


"Linear Walking - Cyclical path" 


1001901 


CUW 


"Upward Inclined Walking - Cyclical path" 


rooi9ii 


ECW 


"Curve Walking Path" 


1001921 


EDW 


"Downward Inclined Walking - Ending path" 


1001931 


EGD 


"Going Down Stairs - Ending path" 


1001941 


EGU 


"Going Up Stairs - Ending path" 


1001951 


ETW 


"Linear Walking - Ending path" 


1001961 


EUW 


"Upward Inclined Walking - Ending path" 
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r001971 SDW "Sitting down" 

[001981 SIT "Sitting" 
[001991 STA "Stance of feet" 

[002001 SUP "Standing Up" 

[002011 FIG. 6 illustrates an example of the state machine concerning these various 

portions of locomotion. 

[002021 FIG. 7 shows an example of a phase sequence mapping, BTW_1 to BTW_25, 
for the Beginning Path of Linear Walking (BTW) portion of locomotion. All locomotion 
portions have similar patterns of phase sequence mapping, though the number of phases may 
vary from one locomotion portion to another. The number of phases depends on the desired 
granularity of the decomposition of the locomotion portion. The phases are determined 
experimentally by observing the states of the four localized plantar pressures at specific time 
intervals, which are determined by the desired granularity. Since a phase is the combination of 
the states of the four localized plantar pressures, the phase boundary conditions are therefore 
defined as the combination of each localized plantar pressure state boundary conditions. 

[002031 For the selection of the portion of locomotion the subject is in, the algorithm 

uses the state machine approach. For this purpose, the algorithm uses a set of events which 
values define the conditions, or portion boundary conditions, to pass from one locomotion 
portion to another. These events are identified by experimentation according to the evolution 
of the localized plantar pressure signals, the complementary signals and their first three 
differentials, as well as the signals from the auxiliary artificial proprioceptors, when the 
subject passes from one locomotion portion to another. 

[002041 Having determined the states of the main artificial proprioceptors 5 sensors, the 

phase of locomotion portion and portion of locomotion of the subject, the TG (44) can be used 
to calculate one or more dynamic parameter values to be converted to an output signal for the 
control of the actuator. Examples of dynamic parameter values are the angular displacement 
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and the torque (or moment of force) at the knee joint of the actuated leg prosthesis (12). Since 
these values are given in real time, they provide what is commonly referred to as the "system's 
trajectory". At any time k during the subject's locomotion, a mathematical relationship is 
selected according to the state of the whole system, that is the states of the main artificial 
proprioceptors, the phase of locomotion portion, the portion of locomotion and the walking 
speed. Following which, the angular displacement 0^ and the moment of force are then 
computed using simple time dependant equations and static characteristics associated with the 
state of the system, thereby providing the joint's trajectory to the knee joint member. This 
process is repeated throughout the subject's locomotion. 

[002051 FIGS. 8a to 8d show examples of data signals from the four localized plantar 

pressure sensors (16) during a standard walking path at 109,5 steps/minute. The four signals, 
yri(t),./rt(t),yri(t) and ftf(t) 9 correspond to the variation in time of the localized plantar pressure 
at the calcaneus region of the left foot (FIG. 8a), the MP region of the left foot (FIG. 8b), the 
calcaneus region of the right foot (FIG. 8c), and the MP region of the right foot (FIG. 8d). 

[002061 In accordance with the present invention, the PRM (42) uses the first, the 

second and the third differentials of each of those four localized plantar pressure signals in 
order to determine the sensors' state. From there, the PRM (42) will be able to determine the 
phase of locomotion portion and portion of locomotion of the subject. 

[002071 FIGS. 9a to 9d and 10a to lOd show examples of graphs of localized plantar 

pressures, as well as their first, second and third differentials, at the calcaneus and MP regions 
respectively, for a linear walking path of 109,5 steps/minute. 

[002081 FIGS. 1 la to lid show graphically the state boundary conditions for a typical 

localized plantar pressure signal, and its first three differentials, at the calcaneous region, while 
FIGS. 12a to 12c do so for the localized plantar pressure signal, and its first two differentials, 
at the MP region. This shows the relationships between the various data and derivative 
signals, and the states. 
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[002091 In use, for the detection of the state of the four localized plantar pressures, 

denoted f^ where x = [1, 4], the PRM (42) uses a set of first state machines to select, at each 
increment in time, the current state of each sensor. For this purpose, the algorithm uses a set 
of events wfre^s whose values define the conditions to pass from one state to another for each 
of the localized plantar pressures. Table 2 lists the events: 

Table 2 - List of events used to evaluate the state boundary condition of a localized 

plantar pressure 



Event 


Acronym 


Description 


Non-Zero of f™ 


FR_BIN X 


Detection of a positive f™ 


First Differentiation of f™ 


FRfstJBIN x 


Detection of positive first differentiation 

Offrx 


Second Differentiation of f re 


FRsec_BIN x 


Detection of positive second 
differentiation of f ra 


Third Differentiation of f^ 


FRtrd_BIN x 


Detection of positive third differentiation 

Offnc 


Static f w 


STA_BIN X 


Detection of a static evolution of all f^ 



[002101 The conditions placed on the values of each of the depicted events of Table 2 

define when the state machines pass from one state to another for each of the localized plantar 
pressures. Table 3 lists the thresholds used to assess if the aforementioned conditions are met, 
in which sum y depicts the five complementary signals, for y = [a, e] as described in Table 4, 
while Table 5 shows the mathematical form of the events used to evaluate the state boundary 
condition of the localized plantar pressures. 
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Table 3 - List of thresholds used to evaluate the state boundary condition of a localized 

plantar pressure 



Threshold 


Acronym 


Description 


Positive value of f^ 


ZV_FR X 


Threshold to consider f™ to be positive 


Positive value of df^/dt 


ZV_FRfst x 


Threshold to consider the first 
differentiation of f^ to be positive. 


Positive value of d 2 f rx /dt 2 


ZV_FRsec x 


Threshold to consider the second 
differentiation of f™ to be positive. 


Positive value of d^/St 3 


ZV_FRtrd x 


Threshold to consider the third 
differentiation of f^ to be positive. 


Position value of dsum y /dt 


ZV_SUMfst 


Threshold to consider the absolute value 
of the first differentiation of sum y to be 
positive. 


2 / 2 

Positive value of d sum y /dt 


ZV_SUMsec 


Threshold to consider the absolute value 
of the second differentiation of sum y to 
be positive 



Table 4 - List of complementary signals built from the four localized plantar pressure f r i, 

fr2 9 fr3? fr4> 



Signal 


Acronym 


Description 


Mathematical value 


Left foot 


sum a 


Localized plantar pressure signal of 
left foot 


(frl+ftf)/2 
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Right foot 


surrib 


Localized plantar pressure signal of 
right foot 


(fr3+fr4)/2 


Both 
calcaneus 


sum c 


Localized plantar pressure signal of 
both calcaneus 


(frl+fr3)/2 


Both MP 




Localized plantar pressure signal of 
both MP 


(fr2 + fr4)/2 


Both feet 


sum e 


Localized plantar pressure signal of 
both feet 


(frl+fr2 + fr3 + fi4)/4 



Table 5 - Mathematical formulation of events 



Acronym 


Mathematical form 


FR_BIN X 


< 


0 if f„{k)<zv _fr; 

1 otherwise 


\ 


FRfst_BIN x 




0 if dfn ^ <ZV FRfst x ) 

d{k) " 

1 otherwise } 


FRsec_BIN x 


< 


0 if d <ZV FRsec x 

d\k) 

1 otherwise 


> 


FRtrd_BIN x 




0 if rf3 {" W <ZV FRtrd x 

d\k) 

1 otherwise 


* 
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STA BIN 



(t 



0 if 
1 



dsum y (k) 



d(k) 



>ZV_SUMfst III 



d 2 sum y (k) 



d\k) 
otherwise 



>ZV SUMsec 



Vy 



J J 



[002111 FIGS. 13 and 14 show, respectively, the diagrams of the state machines used 

for the detection of the state of the localized plantar pressure at the calcaneous and the MP 
regions, while Tables 6 and 7 summarize the state boundary conditions between the states of 
each localized plantar pressure. 



Table 6 - List of state boundary conditions defining the states of the main artificial 

proprioceptors at the calcaneus region 



Current 
State 


State Boundary Conditions 


Next State 


Any state 


!FR_BIN X 


XHZVS 


Any state 


FRJBINx && STA_BIN X 


XHSTA 


Any state 


FR_BIN X && !STA_BIN X && FRfst_BIN x && 
FRsec_BIN x && FRtrd_ BIN X 


XHLSB 


Any state 


FR_BIN X && !STA_BIN X && FRfst_BIN x && 
FRsec_BIN x && !FRtrd_BIN x 


XHLSM 


Any state 


FR_BIN X && !STA_BIN X && FRfst_BIN x && 
!FRsec_ BIN X 


XHLST 


Any state 


FR_BIN X && !STA_BIN X && !FRfst_BIN x && 
!FRsec_ BIN X 


XHUST 
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Any state 


FR_BIN X && !STA_BIN X && !FRfst_BIN x && 
FRsec_ BIN X 


XHUSB 


Table 7 - List of state boundary conditions defining the states of the main artificial 
proprioceptors at metatarsophalangeal region 


Current 
State 


State Boundary Conditions 


Next State 


Any state 


!FR_BIN X 


XMZVS 


Any state 


FR_BIN X && STA BINx 


XMSTA 


Any state 


FR BINx && !STA_BIN X && FRfst_ BIN X && 
FRsec_BIN x 


XMLSB 


Any state 


FR_BIN X && !STA_BIN X && FRfst_BIN x && 
!FRsec_BIN x 


XMLST 


Any state 


FR_BIN X && !STA_BIN X && !FRfst_BIN x && 
!FRsec_ BIN X 


XMUST 


Any state 


FR BINx && !STA_BIN X && !FRfst_ BIN X && 
FRsec_BIN x 


XMUSB 



[002121 FIG. 15 shows a flow chart that depicts the PRM algorithm, which comprises 

two main parts, namely the pre-processing of the main artificial proprioceptors signals and the 
locomotion breakdown, illustrated by blocks 100 and 102 respectively. The sequence of steps 
performed the pre-processing of the main artificial proprioceptors signals, represented by 
block 100, is indicated by the sequence of blocks 104 to 1 18. At block 104, the four localized 
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plantar pressures signals are received from the interface and normalized at block 106 using 
subject specific calibration values. The four normalized local plantar pressures then go 
through the pre-processing steps represented by blocks 104 to 118. At block 112, the four 
normalized local plantar pressures are filtered to reduce their spectral composition. A counter 
is then initialized at block 108, which in turn starts a loop comprising blocks 1 10 to 116. The 
first step of the loop, at block 110, consist in the differentiation of the signals. The signals 
resulting from the differentiation step are filtered at block 112, in order to limit the noise 
induced during the differential computation, and go through binary formatting at block 114. 
At block 1 16, the algorithm checks if the counter has reached 3 iterations. If so, the algorithm, 
having computed all first three derivatives of the four normalized local plantar pressures 
signals, exits the loop to block 102. If not, the algorithm proceeds to block 110 where the 
counter is increased at block 118 and the loop is repeated, in order to computed the next 
derivative, by proceeding to block 110. When the loop exists to block 102, the algorithm 
enters into the locomotion breakdown part of the algorithm. The sequence of steps performed 
by the locomotion breakdown, represented by block 102, is indicated by the sequence of 
blocks 120 to 124. From the four normalized local plantar pressures and their first three 
derivatives, block 120 determines the states of each sensor while blocks 122 and 124 
determine the phase and the portion of locomotion, respectively. 

[002131 The normalization step, represented by block 106, consists in levelling the 

magnitude of the raw data signals according to the anthropomorphic characteristics of the 
subject such as, in the preferred embodiment, the subject's weight. The raw data signals of the 
four localized plantar pressures are divided by the total magnitude provided by the four 
sensors during calibration and then provided as the normalized local plantar pressures to block 
110. 

[002141 At block 1 12 the normalized raw signals of the four localized plantar pressures 

and their first three differentials are numerically filtered to reduce their spectral composition, 
as well as to limit the noise induced during the derivative computation. The preferred 
embodiment of the PRM (42) uses a 2 nd order numerical filter in which the cut-off frequency, 
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the damping factor and the forward shifting have been set, experimentally, to optimize the 
calculation according to the locomotion portion and the type of signal. The PRM (42) may use 
other types of numerical filters as well, for example a "Butterworth" filter, as long as the 
filter's dynamic is similar to the one provided by the 2 nd order filter shown thereafter for each 
locomotion portion. Equation 4 shows the mathematical relationships of the 2 nd order 
numerical filter which is implemented within the PRM (42). Table 8 provides examples of 
filtering parameters for three different portions of locomotion. 

Laplace form 

m 2 Equation 3 

H(s) = -= 2 T 

s 2 +2-<;'CD n -s + co„ 



W ^ Cre . co n in the fienenth damping natural frequency, co n = . ( ° r , C < 1 

— VT2C 7 



• (D r is called the resonance frequency for C, < 1 

• £ is the damping factor 

Recursive form 
H(z)= "> 2 ' " +b > Z " ! 



a, +a 2 z 1 +a 3 z 2 



a,y(k) = b 2 x(k - 1) + b 3 x(k - 2) - a 2 y(k - 1) - a 3 y(k - 2) Equation 4 
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where 



a,=l 



a 2 = -2 a (3 
a 3 = a 2 
b, = 0 



b 2 = 1 - a 



b 3 = a 2 +a 



CO, 



CO, 



-p 



p = cos(co,T e ) 
3 = sin(co r T e ) 
T = sampling rate 



Table 8 - Examples of parameters of 2" order filters used by the PRM 



Portion of locomotion 


Type of 
signal 


Filtering Parameters 


Cut-Off 
Frequency (F c ) 


Damping 
Factor (z) 


Forward 
Shifting 


Linear Walking - 
Beginning path (BTW) 


Raw 


2 


0.680 


7 


Derivative 


3 


0.700 


3 


Linear Walking - 
Cyclical path (CTW) 


Raw 


2 


0.680 


7 




Derivative 


3 


0.700 


3 
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Linear Walking - Ending 


Raw 




0.680 




2 


7 


path (ETW) ! 












Derivative 


3 


0.700 


! 3 



[002151 At block 1 10, the derivatives are obtained by the standard method consisting of 

numerically differentiating the current and the previous samples of localized plantar pressures. 

[002161 The derivatives obtained at block 110 then go through binary formatting at 

block 114. The result of the binary formatting operation will be a "1" if the sign of the 
derivative is positive, u 0" if it is negative. This step facilitates the identification of the sign 
changes of the differentiated signals as binary events. 

[002171 At block 120, the PRM (42) determines the current state of each sensor using 

state machines such as the ones shown in FIGS. 13 and 14. 

[002181 In the PRM (42), the states of the localized plantar pressures are preferably 

expressed as a 10-bit words in which each bit corresponds to a specific possible state. Tables 
9 to 12 list the binary equivalents of each state of the localized plantar pressures at the 
calcaneous and the MP regions of the left and the right foot. Of course, words of different bit 
length may be used as well to represent the state of each localized plantar pressure. 

Table 9 - Numerical labels of the states for the localized plantar pressure at calcaneous 

area of the left foot 



State 


Binary Label 


Decimal 
Label 


LHSBS 


0000000000 1 


0 


LHLSB 


00000000010 


1 
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LHLSM 


00000000 100 


2 


LHLST 

X^X li^lJ X 


00000001000 


3 


LHUST 

X-/X X W O X 


00000010000 


4 
• 


LHUSM 


00000100000 

V v v X V V V v 


5 


LHUSB 


0000 1000000 


6 


LHZVS 


00010000000 


7 


LHSTA 


00 100000000 


8 
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Table 10 - Numerical labels of the states for the localized plantar pressure at 
metatarsophalangeal area of the left foot 



State 


Binary Label 


Decimal 
Label 


LMSBS 


00000000001 


0 


LMLSB 


000000000 1 0 


1 


LMLSM 


00000000100 


2 


LMLST 


00000001000 


3 


LMUST 


00000010000 


4 


LMUSM 


00000 100000 


5 


LMUSB 


00001000000 


6 


LMZVS 


00010000000 


7 


LHSTA 


00 100000000 


8 
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Table 11 - Numerical labels of the states for the localized plantar pressure at calcaneous 

area of the right foot 



State 


Binary Label 


Decimal 
Label 


RHSBS 


00000000001 




RHLSB 


000000000 1 0 


1 


RHLSM 


00000000 1 00 


2 


RHLST 


00000001000 ' 


3 


RHUST 


00000010000 


4 


RHUSM 


00000 100000 


5 


RHUSB 


00001000000 


6 


RHZVS 


00010000000 


7 


RHSTA 


00 100000000 


8 
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Table 12 - Numerical labels of the states for the localized plantar pressure at 
metatarsophalangeal area of the right foot 



State 


Binary Label 


Decimal 
Label 


RMSBS 


00000000001 


0 


RMLSB 


00000000010 


1 


RMLSM 


00000000100 ' 


2 i 


RMLST 


0000000 1 000 


3 


RMUST 


00000010000 


4 


RMUSM 


00000 100000 


5 


RMUSB 


00001000000 


6 


RMZVS 


000 10000000 


7 


RHSTA 


00 100000000 


8 



[002191 At block 122, the PRM (42) generates the phase, which is preferably expressed 

as the direct binary combination of the states of the four localized plantar pressures. 
Accordingly, the phase can be represented by a 40-bit word wherein the lower part of the 
lower half word, the higher part of the lower half word, the lower part of the higher half word 
and the higher part of the higher half word correspond, respectively, to the calcaneous area of 
the left foot, the MP area of the left foot, the calcaneous area of the right foot and the MP area 
of the right foot, as represented in Tables 9 to 12. Table 13 presents an example of the 
identification of a phase from the states of the four localized plantar pressures. 
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Table 13 - Identification of a phase from the states of the main artificial proprioceptors 



State of Localized Plantar Pressure 


Corresponding Phase 


Right Foot 1 


Left Foot ! 


MP area 


Calcaneous 


MP area 


Calcaneous 


0000000100 


0000010000 


0000000001 


0000010000 


00000001000000010000 
00000000010000010000 



[002201 At block 124, the PRM (42) selects the portion of locomotion the subject is 
currently using the state machine shown in FIG. 6. Each portion of locomotion is composed 
of a sequence of phases. 

[002211 Accordingly, Table 14 presents the phases sequence mapping for the Beginning 

Path of Linear Walking (BTW) locomotion portion corresponding to FIG. 7. This table shows 
the label, the decimal value and as well the phase boundary conditions of each phase. 

Table 14 - Example of phases sequence mapping for the locomotion portion labeled 
"Beginning Path of Linear Walking" (BTW) 



Phase 


Phase Boundary Conditions 


Label 


Value 


F r i 


F r2 


F r3 


F r4 


BTW_1 


2751466048002751 
6604800 


8 


8 


8 


8 


BTW_2 


3449306441634493 
96416 


5 


7 


3 


7 


BTW_3 


2281717888 


1 


7. 


4 


7 


BTW_4 


4429217920 


2 


7 


5 


7 
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BTW_5 


17213489280 


4 


5 


6 


7 


BTW6 


1731411980817311 
19808 


4 


7 


5 


7 


BTW_7 


34493988992 


5 


7 


5 


7 


BTW_8 


34494087296 


5 


7 


7 


7 ; 


jj i w_y 


3436186841634361 
86816 




1 
1 


C 

J 


/ 


BTW_10 


34361966720 


5 


1 


7 


7 


BTW_11 


68723802240 


6 


2 


7 


7 


BTW_12 


68727996544 


6 


3 


7 


7 


BTW_13 


68727867520 


6 


3 


1 


7 


BTW_14 


137455732864 


7 


4 


1 


7 


BTWJ5 


137455734912 


7 


4 


2 


7 


BTW_16 


137455739008 


7 


4 


3 


7 


BTW_17 


1374725121281377 
2512128 


7 


5 


2 


7 


BTWM8 


1374725162241377 
2516224 


7 


5 


3 


7 


r>TW 10 
Dl W 1 y 


1374725244161377 
252416 


7 




A 
t 


7 


BTW_20 


137573187712 


7 


7 


4 


7 


BTW_21 


137573204096 


7 


7 


5 


7 


BTWJ22 


137573187586 


7 


7 


4 


1 


BTW_23 


137573203970 


7 


7 


5 


1 


BTW_24 


137573236740 


7 


7 


6 


2 
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BTW_25 


137573236744 


7 


7 


6 


3 















[00222] Table 15 enumerates a sample of boundary conditions associated with the 

locomotion portion of the sitting and typical walking on flat ground movements, while Table 3 
lists the thresholds used to assess if the aforementioned conditions are met. 
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Table 15 - Example of a list of portion boundary conditions defining specific locomotion 
portions such as sitting movements (STA-SUP-SIT-SDW-STA locomotion portion) and 
typical wakffldwalking on flat ground (STA-BTW-CTW-ETW-STA locomotion portion) 



Current 
Portion 


Set of Events 


JMext 
Portion 




SWINGieg 






ISTATIC GRieg || !STATIC_GR prost 




STA 


FR_LOW prost heel 
FR BINieg heel 

BTW_SWING 


BTW 




FR_HIGH leg _hee. 






FR_HIGH prost heel 

PKASDW 


SDW 


BTW 


STATICGRieg 
STATIC_GRp rost 


ETW 


SUM_BIN prost 
SWING prost 


CTW 


CTW 


STATICGRieg 
STATIC_GR pr0S t 


STA 
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Current 
Portion 


aet oi Hi vents 


Next 
Portion 




FR BINprost heel 






rKDlJNiegheel 






PKAETW 


ETW 




STATIC_GR, eg || STATIC GRprost 




ETW 


PKA_STA 


STA 


SDW 


PKA_SIT 


SIT 


PKA _STA 


STA 




GR_POS|eg 






MINSIT 




SIT 


FRHIGHiegmp 

FR_HIGH pros t_ mp 


SUP 




PKA STA 


STA 


SUP 


!SUM_BIN pros , 
!SUM_BIN leg 


SIT 


PKA STA 


STA 




!PKA_SUP_RAMP 


SIT 
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Table 16 - Example of a list of events used to evaluate the portion boundary conditions 
defining specific locomotion portions such as sitting movements (STA-SUP-SIT-SDW- 
STA locomotion portion) and typical walking on flat ground (STA-BTW-CTW-ETW- 

STA locomotion portion) 



Event 


Acromvn 


Descrintion 


Swing occurence 


SWINGy 


Detection of a swing prior to a foot strike 


Non-Zero of f,* 


FR_BIN X 


Detection of a positive f™ 


LOW trx 


rK_LU W x 


Detection of frx level between the zero 
envelope and the STA envelope 


Highf ra 


FR_HIGH X 


Detection of f^ level above the STA envelope 


Static gry 


STATICGRy 


Detection of gry level below the zero angular 
speed envelope and the zero acceleration 

wll V vlUUV^ 


Non-Zero of sum y 


SUMBINy 


Detection of a positive sum y 


BTW swing 
occurrence 


BTW_SWING 


Detection of typical walking g r je g during leg 
swing 


Positive gry 


GR_POSy 


Detection of a positive gry 


Minimum sitting 


MIN_SIT 


Detection of a minimum time in portion SIT 


Sit down knee angle 


PKA_SDW 


Detection of knee angle higher than the STA 
envelope 


End walking knee 
angle 


PKAETW 


Detection of knee angle lower than the STA 
envelope 
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Event 


Acromyn 


Description 


Stance knee angle 


PKAJSTA 


Detection of knee angle lower than the STA 
envelope 


Sit down knee angle 


PKASIT 


Detection of knee angle higher than the SIT 
envelope 


Standing up knee 
angle 


PKASUPRA 
MP 


Detection of standing up knee angle evolution 



where • X stands for leg_heel, legjnp, prostheticjieel or prosthetic_mp 
• Y stands for leg or prosthesis 

[002231 The normalization step of block 106 uses specific calibration values. These 

values are computed the first time a subject uses the actuated prosthesis (12) or at any other 
time as may be required. Two calibration values are preferably used: the zero calibration 
value and the subject's weight calibration value. The zero calibration value consists in the 
measurement of the four localized plantar pressures when no pressure is applied to the sensors, 
while the subject's weight calibration value is the subject's weight relative to the magnitude of 
the total response of the sensors. 

[002241 The algorithm to obtain the zero calibration value of the sensors is depicted by 

the flow chart shown in FIG. 16. The sequence of steps composing the algorithm is indicated 
by the sequence of blocks 200 to 222. In block 200, the algorithm starts with the four localized 
plantar pressures. At block 202, the subject sits on a surface high enough such that his feet 
hang freely in the air. Then, at block 204, the subject lightly swings his feet back and forth, 
which initialises a timer at block 206, which in turn starts a loop comprising blocks 208, 210 
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and 212. At block 208, the algorithm checks if the timer has reached 10 seconds, if so, then 
the algorithm exist sexits the loop to block 220, if not, the algorithm proceeds to block 210 
and records the zero value of the four sensors. Then, at block 212, the timer is increased and 
the loop is repeated by proceeding to block 208. At block 220, the average of each localized 
plantar pressures is computed and finally provided as the zero calibration value at block 222. 

[002251 In a similar fashion, the algorithm to obtain the subject's weight calibration 

value is depicted by the flow chart shown in FIG. 17. The sequence of steps composing the 
algorithm is indicated by the sequence of blocks 300 to 322. In block 300, the algorithm starts 
with the four localized plantar pressures. At block 302, the subject stands up in a comfortable 
position, feet at shoulder width distance, while maintaining the body in the stance position. 
Then, at block 304, the subject slowly swings back and forth and then left to right, which 
initialises a timer at block 306, which in turn starts a loop comprising blocks 308, 310 and 
312. At block 308, the algorithm checks if the timer has reached 10 seconds, if so, then the 
algorithm exists the loop to block 320, if not, the algorithm proceeds to block 310 and records 
the subject's weight relative to the magnitude of the total response of the sensors. Then, at 
block 312, the timer is increased and the loop is repeated by proceeding to block 308. At 
block 320, the average of each localized plantar pressures is computed and finally provided as 
the weight calibration value at block 322. 

[002261 FIG. 18 shows a flow chart that depicts the TG algorithm used to establish a 

relationship, in real-time, between the output of the PRM (42) and localized plantar pressures 
and the knee joint trajectory. The sequence of steps composing the algorithm is indicated by 
the sequence of blocks 400 to 408. At block 400, the algorithm receives the normalized 
localized plantar pressures, the phase of locomotion portion and the portion of the locomotion 
from the PRM (42). Then, at block 402, the walking speed of the subject, in steps per minute, 
is obtained from computing the number of frames between two heel strikes, while taking into 
account the sampling frequency, and is binary formatted. More specifically, the subject's 



45 



speed estimate x v [k] (steps/minute) is obtained from computing the number of frames 
between two heel strikes s heel [ k] (frames/step): 

f 

= 60 rn ' n n Equations 

where /, is the frame sampling frequency (frames/second). 
A heel strike event occurs when: 

thresholdheelloading < f rif [k] - f ri/ [*-l], i f = 1, 3 Equation 6 

[002271 At block 404, the algorithm uses the normalized localized plantar pressures, the 

phase of locomotion portion, the portion of the locomotion and the subject's speed in binary 
format to identify a set of linear normalized static characteristics linking the knee joint 
kinetic/kinematic parameters with the subject's locomotion in a lookup table. At block 406 
the TG (44) comprises two transformation functions which compute the kinetic/kinematic 
parameters at time k, which are the angular displacement ©^(k) and the moment of force 
(torque) m^k), using the localized plantar pressures and their corresponding mathematical 
relationships (time-dependant equations and static characteristics) identified at block 404. The 
values of the kinetic/kinematic variables are then provided to the REG (48) at block 408. 

[002281 The transformation functions used by the TG (44) at block 406 may generally 

be represented by a system of equations such as: 

9 g)h (k) = (k), X (k), v(k)) + Q 2 (» 2 (k), X (k), v(k)) + . . . + Equation 7 

<»o-l ( k )> X00. V < k » + ^q(^q ( k )> Xto, V(k)) 



m g h (k) = Mj(d, (k), X (k), v(k)) + M 2 ($ 2 (k), x (k), v(k)) + . . . + 
M q _ t (k), X (k) f v(k)) + M q ($ q (k), x(k), v(k)) 



Equation 8 
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where * g = [sagittal (sg), frontal (fr), transversal (tr)] is the plane of the motion 

• h = [hip (hp), knee (kn), ankle (an), metatarsophalangeal (mp)] is the joint 

• q is the number of the main artificial proprioceptors' sensors 

• $ q is the phenomenological entity related to the locomotion and provided by the 
main artificial proprioceptors' sensors 

• Q q is the transformation function between the phenomenological entity related to 
the locomotion, the kinematic variables of the lower extremities and the time 

• M q is the transformation function between the phenomenological entity related to 
the locomotion, the kinetic variables of the lower extremities and the time 

• & q is the phenomenological entity related to the locomotion and provided by the 
main artificial proprioceptors' sensors 

• X(k) = Q(p h (k),p r (k),v(k)) is the state of the whole system (amputee and the 
AAP) in which k is the current increment 

• p h (k) is the phase of the respective locomotion portion 

• p r (k) is the locomotion portion 

• v(k) is the walking speed 

• k is the current increment 



[002291 In the case where the TG (44) uses polynomial relationships of order n, 

Equation 7 and Equation 8 become: 
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0 g , h (k) = a u ( X (k),v(k)).d I (k) + ... + a 1 , n (x(k),v(k)).d 1 (kr + Equation9 
a 2iI (x(k),v(k))d 2 (k) + ... + a 2 , n (x(k),v(k))-9 2 (k) n +...+ 
a q . u (x(k).v(k)).d q _,(k)+...+a q _ lin (x(k),v(k))d q . 1 (kr + ...+ 
a p ,(x(k),v(k)).d q (k) + ... + a q>n (x(k),v(k)).9 q (k) n 

m g , h (k) = b u (x(k) 1 v(k)).d 1 (k) + ... + b In (x(k),v(k)).d I (kr + Equation 10 

b 2 ,(x(k),v(k)).& 2 (k) + ... + b 2n (x(k),v(k))-3 2 (kr + ... + 
b q ., 1 (x(k),v(k)).d q . 1 (k)+... + b q . 1 , n (x(k),v(k)).& q . I (k) n +...+ 
b q ,,(x(k),v(k)).& q (k) + ... + b q , n (x(k),v(k))-9 q (k) n 

where a, j(x(k)) and b, j(x(k)) i = l-»q are the coefficients for the state %(k) of the 
whole system and the walking speed v(k) and n is the order of the polynomial 

The preferred embodiment uses four localized plantar pressures, thus Equation 9 and Equation 
1 0 become: 

0 9>h (k) = a u (x(k),v(k)).f rl (k)+... + a l , n (x(k) 1 v(k)).f rl (k) n + Equation 11 

a 2 ,(x(k),v(k))f r2 (k) + ... + a 2 , n (x(k),v(k))f r2 (k) n + 
a3,(x(k),v(k))f r 3(k)+... + a3 in (x(k),v(k))f r 3(k) n + 
a 4 ,(x(k),v(k))f r 3(k) + ... + a 4 , n (x(k),v(k)).f r3 (kr 

»" g ^k) = b u (x(k),v(k))-f rl (k) + ... + b 1 , n (x(k) I v(k))..f rl (kr + Equation 12 

b 2 ,(x(k), v(k)) • f r2 (k) + ... + b 2n (x(k), v(k)) • f r2 (k) n + 
b 3 , I (x(k) I v(k))f r 3(k)-f... + b3 >n (x(k),v(k))f r3 (k) n + 
b 4 ,(x(k),v(k)).f r 3(k) + ... + b 4 , n (x(k),v(k))f r3 (k)' 1 

where a,j(x(k)) and b f j (5c(k)) i = 1 — >q are the coefficients for the state x(k) of the 
whole system and the walking speed v(k) and n is the order of the polynomial 
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[002301 Since all the kinetic/kinematic parameters O^Ck) and m^k) are computed 

from non complex mathematical relationships, the computation of the trajectory is simple and 
fast and can be calculated by a non-sophisticated electronic circuit board. 

[002311 The mathematical relationships (time-dependant equations and static 

characteristics) used in these non complex mathematical relationships are contained in a 
lookup table referenced at block 404. FIG. 19 shows a flow chart that depicts the algorithm 
used to create the TG lookup table. The sequence of steps composing the algorithm is 
indicated by the sequence of blocks §00100 to 512. At block §00100, the algorithm measures 
the selected phenomelogical parameters, which in the preferred embodiment are the localized 
plantar pressures, and the kinetc/kinematic parameters Q^QO and mkn(k) of a subject. The 
measured phenomelogical parameters are then normalized in function of the subject's weight. 
At block §0 4104 , the static characteristics linking the phenomelogical parameters to the 
kinetc/kinematic parameters and the time-dependant equations linking to the time are 
identified and are then normalized at block §0§106. Then at block §08 108 , the mathematical 
relationships (time-dependant equations and static characteristics) are broken down according 
to the phenomelogical parameters, the phases of locomotion portion, portions of locomotion, 
the speed of the subject and in the case were Equation 1 1 and Equation 12 are linear functions, 
the binary formatted data signals. For each set of mathematical relationships (time-dependant 
equations and static characteristics) created by the breakdown, a polynomial regression is 
applied, at block 510, to the mathematical relationships (time-dependant equations and static 
characteristics) contained in the set. Finally, at block 512, the results of the polynomial 
regressions are stored in the lookup table and are indexed according to the breakdown of block 
§08108. 

[002321 The method for building this TG lookup table depicted by the flow chart of 

FIG. 19 may be applied to any equations belonging to the following analytical/logical family 
of functions: 
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y g , h = a„ + a,x, + a 2 x? + • • • + a n x? + 
b 0 + b,x 2 + b 2 x^ + -- + b m x™ + 

P 0 + p,x x + p 2 x;+- + M2 

n m J] 

i=0 i=0 i=0 



»i n 2 -x 

y g . h =E a u x i + Z a 2.i x 2 +-"Z a x,i x x 



i=0 i=0 i=0 



yg.h=2Z a j,i- x ; B . M 

j=i >=o Equation 13 

where • y g h j s fl^ estimated kinematic ( 0 g h ) or kinetic ( m g h ) variables for the g lower 
extremities joint through the h ftteft plane of motion 

• g is the lower extremities joint among the following set: hip, knee, ankle and 
metatarsophalangeal 

• h is the plane of motion among the following set: sagittal, frontal and 
transversal 

• Xj is the j* locomotion related phenomenon, for example the f 1 localized 
plantar pressure 

• ajj is the i A coefficient associated the j th locomotion related phenomenon 
denoted xj 
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• n j is the order of the polynomial depicting the locomotion related 
phenomenon denoted Xj 

• X is the number of locomotion related phenomena 

[002331 If it is considered that the family of functions in Equation 13 are dependant on 

the state of the system they depict, thus following system of equations is obtained: 

x i 

y g .h =ZzXi( x )- x j 

H i=o Equation 14 

where x is the time dependant state vector of the system 

[002341 In the preferred embodiment, Xj may be substituted by the localized plantar 

pressures denoted f rif , where if = [1, %]. In the case of time-dependant equations, Xj may be 
substituted by the time. Thus, in the case of plantar pressures, Equation 14 becomes: 

y g ,h=ZZ a irj( X )' f rl 

i f =i i-o Equation 15 

where x is the time dependant state vector of the system 

[002351 Previously, y g ,h has been defined as the estimated kinematic (0 gh ) or kinetic 

(m gh ) variable for the g lower extremities joints through the h plan of motion. Thus, 
Equation 1 5 may be written as: 



51 



i f =l i=0 



or 



"g,h=£i>i f ,i(*)< 



i f =l i=0 



Equation 16 



Equation 17 



[002361 The goal is the identification of the Equation 16 and Equation 17 functions 

from a set of n s samples, obtained from experimentation. A sample contains data related to 

the locomotion related phenomenon along with the corresponding kinematic (0 gth ) or kinetic 

(m gi h) variables. 

1002371 The following array of data is obtained from experimentation: 

Table 16 - Data obtained from experimentation 





t 


X 




x 2 








x x 




m g>h 


1 






















2 
























































































"s 























where 



j , x is the index and the number of locomotion related phenomena 
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• i s , n s is the index and the number of frames 

• t is the time [s] 

• x is the time dependant state vector of the system 

• Xj is the selected locomotion related phenomenon 

• 0 g h is the kinematic variables for the g lower extremities joint through the h 
plan of motion 

• m g h is the kinetic variable for the g lower extremities joint through the h plan 
of motion 

[002381 T he logical functions a jti (x) are then presented in the form of a look-up table, 
as shown in the following example: 

Table 17 - Look-up table example 



aj,i(x) 


t 


X 


a i,o 


a u 




a 2,0 


a 2,. 




a x.o 


a x.i 




a x,n x 


1 


Xi 


34. 
5 


23,1 




12,3 


92,5 




83,6 


52,4 




72, 
5 


2 


x 2 


23, 
6 


87,5 




64,4 


84,9 




93,4 


38,6 




28, 
5 
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c 


A 1C 


76, 
9 


82,5 




93,3 


J.'.'c 




37,5 


82,3 




84, 
4 


























"c 




61, 
4 


90,6 




72,3 


26,4 




83,5 


26,4 




28, 
6 



/ c , « c index and dimension of the look-up table (n c is the number of considered 

where • 

quantized states) 

• x is the time dependant state vector of the system 

[002391 Table 17 establishes the relationship between the time dependent state vector of 

the system, the locomotion related phenomenon and the kinematic and the kinetic variables of 
the lower extremities joints, which are the following static characteristics: 

6g,h =f 6 (x 5 x) Equation 18 

m gh =f m (x,x) Equation 19 

[002401 The methodology used to identify the parameters a j(i (x) is based on the 

application of a curve-fitting algorithm to a set of data provided from experimentation on 
human subjects. This experimentation is performed in a laboratory environment under 
controlled conditions, yielding a set of data in the form of an array, as shown in Table 16. 

[002411 The curve- fitting algorithm is used to obtain the parameters a^x) for every 

given time dependant state vector x . This data is used to construct the look-up table, as 
shown in Table 17. 
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[002421 An example of configuration for the method previously described is presented 

below: 

14002431 t he particularities of this configuration are: 

a. the locomotion related phenomenon is composed of a set of four localized 
plantar pressures supplied by the main artificial proprioceptors; 

b. the time dependant state vector is composed of: 

i. the walking speed of the subject; 

ii. the phase of locomotion portion and the portion of locomotion; 

iii. and if Equation 16 and Equation 17 are linear functions: 

jiiriv. the binary formatted magnitude of the four localized plantar pressures; 

24002441 the family of functions depicting the static characteristics 0 g h =f (x,x) and 
m g h = f m (x,x) , as described in Equation 16 and Equation 17; 

[002451 or 

a. the family of functions depicting the time-dependant equations 0 g h = / (x,f) 

and m gh = f m (x,t), as described in Equation 16 and Equation 17 when f rif is 
substituted by time t. 

34002461 the selected lower extremities joints is the knee joint, which is the joint between 
the thigh (th) and the shank (sh); 

44002471 the selected plan of motion is the sagittal plan; 

[002481 In the case where Equation 16 and Equation 17 are linear functions, the time 

dependant state vector further comprises the binary formatted magnitude of the four localized 
plantar pressures as added parameters to further segment the curve representing the kinematic 
(0 g ,h) or kinetic (m g ,h) variables. This is due to the fact that, as shown by FIG. 20, that for a 
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given portion of locomotion, phase of locomotion portion and subject's speed, the curve 
representing the kinematic (6 g)h ) or kinetic (i% h ) variables cannot efficiently be approximated 

by a linear function. To that end, the binary formatted plantar pressures are used to further 
subdivide the phase of locomotion portion in a number of intervals on which the curve 
representing the kinematic (0 gh ) or kinetic (m g>h ) variables may be approximated by linear 
functions. FIG. 21 is a close-up view of FIG. 20 where it is shown that the curve representing 
the kinematic (0 gh ) or kinetic (m g> h) variables appear relatively linear on each of the added 

subdivisions. Thus, the use of Equation 16 and Equation 17 which are linear functions entails 
that the time dependant stated vector will further comprise the binary formatted plantar 
pressures. 

[002491 It should be noted that in the preferred embodiment, the lookup table contains 

mathematical relationships that have been normalized in amplitude. The TG (44) uses the 
relative value of the localized plantar pressures instead of the magnitude of the signal. This 
means that the localized plantar pressures are set into a [0, 1] scale for a specific state of the 
whole system %(k). This ensures that the mathematical relationships (time-dependant 
equations and static characteristics) are independent of the weight of the subject. It is worth to 
note that, because the TG's architecture use the walking speed as a component of the state of 
the whole system, the static characteristics lookup table is valid for any walking speed 
comprised within the operational conditions, which are, in the preferred embodiment, between 
84 and 126 steps/min, though the lookup table may be computed for other intervals. 

[002501 The Regulator (48) uses a control law with a similar structure to control 

algorithms currently employed in numerous commercial or experimental applications. 
Various control laws may be implemented in the Regulator (48), examples of which are 
provided below. 

[002511 First, the Regulator (48) may use a simple PID control law, which is written as: 
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^t) =k d x(t) + k p x(t) + k, Jxdt Equation 20 

where • ka is the gain associated to the differential component of the regulator 

• kpis the gain associated to the proportional component of the regulator 

• ki is the gain associated to the integral component of the regulator 

• Xi is the requested trajectory 

• x 0 is the trajectory performed by the system 

• x is the error between the requested (xi) and performed trajectory (x 0 ) 

• jj, is the set point intended to the system 

applied to the proposed system, that is x = 0 or x = m , we have: 

u* h (t) = k dXg>h (t) + k p x g , h + k ; jx gh dt Equation 21 

where • g = [sagittal (sg), frontal (fr), transversal (tr)] is the plan of the motion 

• h = [hip (hp), knee (kn), ankle (an), metatarsophalangeal (mp)] is the joint 

• x = 0 or m 

where the transfer function between the error x and the set-point is expressed as: 

^ th (t) = b 2 >z 2 +b r z-f-b 0 Equation 22 

x gh (t)" z(z-l) 

where • b2 = ki + k p + k<j 
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• b, = -(k p + kd) 

• b 0 = k<i 

• x = 0 or m 

in which the corresponding recurrent equation is: 

Hg. h (k) = Km (k - 1) + b 0 • x g , h (k - 2) + b, • x gh (k - 1) + b 2 • x gh (k) Equation 23 

where ■• k is the current increment 

• x = G or m 

[002521 Secondly, the Regulator (48) may use an adaptive PID control law. The 

transfer function of an adaptive PID is the same as that of a conventional PID but the 
parameters b2, bi and bo are function of the state of the whole system %(k) . From Equation 
23, the recurrence equation of the adaptive PID is: 

(k) = (k - 1) + b 0 ( X (k)) • x g)h (k - 2) + Equation 24 

bt(x(k))-x g , h (k-l) + b 2 ( X (k)).x g>h (k) 

where • k is the current increment 

• x = 0 or m 

[002531 Thirdly, the Regulator (48) may use a conventional PID with measured 

moment, which may be written as: 

f £ (k) = f g m h (k) + f g>h (k) Equation 25 

where • f ™ h (k) is the force measured at the joint 
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• f h (k) is the force generated by the regulator 

• f £ h (k) is the set point of the force intended to the joint 

[002541 Form Equation 22, the transfer function between the position error x g h and the 

force set-point f g>h (k) is expressed as: 



f g,h(0 =K /b 2 -z 2 +b r z + b 0 



Equation 26 



x gh (t) ^ z(z-l) 

where • K is the gain yielded by the device between the position and the force set point 

• x = 0 or m 

[002551 Thus, the recurrent equation of the final force set point f£ h (k) i s given by the 

following relationship: 

f g % (k) = f m (k) + f g>h (k - 1) + b 0 • x g>h (k - 2) + Equation 27 

b,x gh (k-l) + b 2 x g>h (k) 

where • k is the current increment 

• x = 9 or m 



